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Abstract  Beamforming  methods  are  used  extensively  in  a  variety  of  different  areas,  where  one 
of  their  main  goals  is  to  estimate  the  source  signal  amplitude  sft)  from  the  array  observations  yft) 
=  s(t)a  +  ift)  +  eft),  t  =  1,2,...,  where  a  is  the  steering  vector,  i(t)  is  the  interference,  and  eft)  is  a 
Gaussian  noise  vector  [1,  2], 

To  estimate  sft),  we  may  use  a  beamformer  with  weights  w  so  that  sft)  =  vj*y(t),  where  sft)  is  an 
estimate  of  sft).  To  ensure  that  sft)  is  close  to  sft)  in  some  sense,  we  may  design  the  beamformer 
weights  to  minimize  the  MSE.  However,  since  the  MSE  of  a  linear  beamformer  depends  in  general 
on  the  unknown  signal  power  oi,  we  cannot  directly  minimize  the  MSE.  A  possible  approach  is  to 
minimize  the  MSE  subject  to  a  constraint  on  the  beamformer  that  ensures  that  the  MSE  does  not 
depend  on  Os,  which,  as  we  show  below,  results  in  the  conventional  Capon  beamformer.  However, 
this  approach  does  not  guarantee  a  small  MSE,  so  that  on  average,  the  resulting  estimate  of  sft) 
may  be  far  from  sft).  Instead,  it  would  be  desirable  to  design  a  robust  beamformer  whose  perfor¬ 
mance  is  reasonably  good  access  all  possible  signal  powers. 

In  our  work,  we  propose  a  minimax  regret  beamformer  whose  MSE  is  uniformly  as  close  as  possible 
to  that  of  the  optimal  beamformer  that  knows  of,  for  all  possible  values  of  of.  Thus,  we  ensure  that 
over  a  wide  range  power  signal  of  values,  our  beamformer  will  result  in  a  relatively  low  MSE. 

Specifically,  the  MSE  corresponding  to  a  beamformer  w  is 


E(  |  sft)  -  sft)  | 2)  =  w*Rw  +  erf  1 1  -  w*a|2, 


(1) 


where  R  is  the  interference+noise  covariance  matrix,  which  is  typically  replaced  by  the  sample 
covariance.  Since  o2  is  not  known,  we  cannot  choose  an  estimator  to  minimize  the  MSE  directly. 
One  approach  is  to  force  the  term  depending  on  of  to  0,  and  then  minimize  the  MSE,  i.e., 


min  w*Rw  subject  to  w*a  =  1, 


(2) 


which  leads  to  the  Capon  beamformer.  However,  this  does  not  guarantee  a  small  MSE. 

Based  on  the  ideas  of  [3],  we  propose  a  competitive  beamforming  approach,  in  which  the  beam- 
former  w  is  designed  to  minimize  the  worst-case  regret  over  all  values  g2<U2,  where  the  regret  is 
defined  as  the  difference  between  the  MSE  using  a  beamformer  ignorant  of  the  signal  power,  and 
the  smallest  possible  MSE  attainable  with  a  beamformer  that  knows  the  power.  This  ensures  that 
the  performance  of  the  resulting  minimax  regret  beamformer  minimizing  the  MSE  when  the  signal 
power  is  known.  The  upper  bound  U  is  estimated  as  Uft)  =  I  w*y('t>  I  using  one  of  the  conventional 
beamformers  w.  The  resulting  estimate  of  sft)  is 


) 


a*R-V t) 


a*R  a 


t  =  1,  2,... 


(3) 
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ABSTRACT 

We  consider  the  problem  of  designing  a  linear  beamformer 
to  estimate  a  source  signal  s(t)  from  array  observations.  Con¬ 
ventional  beamforming  methods  typically  aim  at  maximizing  the 
signal-to-interference-plus-noise  ratio  ( SINR ).  However  this  does 
not  guarantee  a  small  mean-squared  error  (MSE),  hence  on  av¬ 
erage  their  resulting  signal  estimate  s(t)  can  be  far  from  s(t). 
To  ensure  that  s(t)  is  close  to  s(t),  we  propose  using  the  more 
appropriate  design  criterion  of  MSE.  Since  the  MSE  depends 
in  general  on  s(t)  which  is  unknown,  it  cannot  be  minimized 
directly.  Therefore  we  develop  a  competitive  beamforming  ap¬ 
proach,  in  which  the  beamformer  is  designed  to  minimize  the 
worst-case  regret  over  all  s(t),  where  the  regret  is  the  difference 
between  the  MSE  using  a  beamformer  ignorant  of  s(t)  and  the 
smallest  possible  MSE  attainable  with  a  beamformer  that  knows 
s(t).  Thus,  we  ensure  that  over  a  wide  range  of  signal  values,  our 
beamformer  will  result  in  a  relatively  low  MSE.  We  demonstrate 
through  numerical  examples  that  the  proposed  minimax  regret 
beamformer  (MMR)  outperforms  several  existing  standard  and 
robust  beamformers,  for  wide  range  of  SNR  values. 

1.  INTRODUCTION 

Beamforming  is  a  classical  method  of  processing  temporal  sensor 
array  measurements  for  signal  estimation,  interference  cancella¬ 
tion,  or  source  direction  and  spectrum  estimation  [1,  2,  3],  It  has 
ubiquitously  been  applied  in  areas  such  as  radar,  sonar,  wireless 
communications,  speech  processing,  medical  imaging,  radioas¬ 
tronomy,  etc. 

Conventional  approaches  for  designing  beamformers  typi¬ 
cally  attempt  to  maximize  the  signal-to-interference-plus-noise 
ratio  (SINR).  Maximizing  the  SINR  requires  knowledge  of  the 
interference-plus-noise  covariance  matrix  and  the  array  steering 
vector.  Since  this  covariance  is  unknown,  it  is  often  replaced  by 
the  sample  covariance  of  the  measurements,  resulting  in  deteriora¬ 
tion  of  performance  with  higher  signal-to-noise  ratio  (SNR)  when 
the  signal  is  present  in  the  training  data.  Some  beamforming  tech¬ 
niques  are  designed  to  mitigate  this  effect  [4,  5,  6,  7,  8],  whereas 
others  are  developed  to  also  overcome  uncertainty  in  the  steering 
vector  [9,  10,  11].  However,  maximizing  SINR  may  not  guarantee 
a  good  estimate  of  the  signal.  In  an  estimation  context,  where  our 


The  work  of  A.  Nehorai  was  supported  by  the  Air  Force  Office  of 
Scientific  Research  Grant  F49620-02- 1-0339,  the  National  Science  Foun¬ 
dation  Grants  CCR-0105334  and  CCR-0330342,  and  the  Office  of  Naval 
Research  Grant  N00014-01-1-0681. 


goal  is  to  deign  a  beamformer  in  order  to  obtain  an  estimate  of  the 
signal  amplitude  that  is  close  to  the  true  amplitude,  it  would  make 
more  sense  to  choose  the  weights  to  minimize  an  objective  that  is 
related  to  the  estimation  error,  rather  than  the  SINR. 

In  this  paper  we  derive  a  beamforming  method  for  estimating 
a  signal  in  the  presence  of  interference  and  noise  using  the  mean- 
squared  error  (MSE)  as  the  performance  criterion.  Computing  the 
MSE  shows,  however,  that  it  depends  explicitly  on  the  unknown 
signal  in  the  deterministic  case,  or  the  unknown  signal  power  in 
the  stochastic  case,  hence  cannot  be  minimized  directly.  Thus,  we 
aim  at  designing  a  robust  beamformer  whose  performance  in  terms 
of  MSE  is  good  across  all  possible  values  of  the  unknowns.  To 
develop  a  beamformer  with  this  property,  we  employ  a  new  com¬ 
petitive  estimation  framework,  which  has  been  recently  proposed 
for  solving  robust  estimation  problems  [12],  This  framework  con¬ 
siders  a  general  linear  estimation  problem,  and  suggests  a  linear 
estimator  whose  performance  is  as  close  as  possible  to  that  of  the 
optimal  linear  estimator  for  the  case  in  which  the  model  parame¬ 
ters  are  completely  known.  Specifically,  the  estimator  is  designed 
to  minimize  the  worst-case  regret,  which  is  the  difference  between 
the  MSE  of  the  estimator  in  the  presence  of  uncertainties,  and  the 
smallest  attainable  MSE  with  a  linear  estimator  that  knows  the  ex¬ 
act  model.  Based  on  this  framework,  we  propose  a  minimax  regret 
(MMR)  beamformer  whose  MSE  is  uniformly  as  close  as  possible 
to  that  of  the  optimal  beamformer  that  knows  the  signal  parame¬ 
ters,  for  all  possible  parameter  values,  as  we  detail  below  in  the 
next  section.  Thus,  we  ensure  that  our  proposed  beamformer  will 
result  in  a  relatively  low  MSE  over  a  wide  range  of  signal  values. 

In  Section  2  we  present  the  problem  formulation  and  review 
existing  methods.  In  Section  3  we  develop  the  proposed  MMR 
beamformer.  In  Sections  4  and  5  we  discuss  practical  considera¬ 
tions  and  present  numerical  examples  illustrating  the  advantage  of 
the  proposed  MMR  beamformer  over  several  existing  standard  and 
robust  beamformers,  for  wide  range  of  SNR  values. 

2.  PROBLEM  FORMULATION 

We  denote  vectors  in  Cm  by  boldface  lowercase  letters  and  matri¬ 
ces  in  Cnxm  by  boldface  uppercase  letters.  I  denotes  the  identity 
matrix  of  appropriate  dimension,  (■)*  denotes  the  Hermitian  con¬ 
jugate,  and  (■)  denotes  an  estimated  vector  or  matrix. 

Beamforming  methods  are  used  extensively  in  a  variety  of  dif¬ 
ferent  areas,  where  one  of  their  main  goals  is  to  estimate  the  source 
signal  amplitude  s(t)  from  the  array  observations 

y(f)  =  s(f)a  +  i(f) +  e(t),  t  =  l,...,JV 


(1) 


where  y(t)  £  CM  is  the  complex  vector  of  array  observations  at 
time  t  with  M  being  the  number  of  array  sensors,  a  is  the  signal 
steering  vector  which  depends  on  the  degree  of  arrival  (DOA)  of 
the  wavefront  plane  associated  with  s(t)  with  respect  to  a  uniform 
linear  array  (ULA)  of  sensors,  s(t)  is  the  signal  amplitude,  i(t) 
is  the  interference,  e(f)  is  a  Gaussian  noise  vector  and  N  is  the 
number  of  snapshots  [1,2]. 

The  source  signal  amplitude  s(f)  may  be  a  deterministic  un¬ 
known  signal,  such  as  a  complex  sinusoid,  or  a  stochastic  station¬ 
ary  process  with  unknown  signal  power.  Since  the  statistics  of  s(t) 
are  unknown,  in  our  development  below  we  will  treat  s(t)  as  a  de¬ 
terministic  signal.  Note,  that  as  we  demonstrate  in  Section  5,  the 
algorithms  we  develop  can  be  applied  to  both  deterministic  and 
stochastic  signals. 

Our  goal  is  to  estimate  the  signal  amplitude  s(t)  from  the  ob¬ 
servations  y(f)  using  a  set  of  beamformer  weights  w(t),  where 
the  output  of  a  narrowband  beamformer  is  given  by 

s(t)  =  w*(t)y(t),  t  =  l,...,N.  (2) 


Traditionally,  the  beamformer  weights  w(t)  =  w  are  chosen  to 
maximize  the  SINR 


SINR  oc 


w*Ri+ew’ 


(3) 


where 

Ri+e  =  E{(i  +  n)(i  +  n)*}  (4) 

is  the  interference+noise  covariance  matrix.  The  weight  vector 
maximizing  the  SINR  is  given  by 


loaded  Capon  beamformer.  Various  methods  have  been  proposed 
for  choosing  the  diagonal  loading  factor  see  e.g.,  [5].  A  heuristic 
choice  for  £,  which  is  common  in  applications,  is  £  «  10 a2,  where 
a2  is  the  noise  power  in  a  single  sensor. 

Another  popular  approach  to  estimating  R,+e  is  the 
eigenspace  approach  [6,  7,  8],  in  which  the  covariance  matrix  is 
estimated  as 

Reig  =  R Pa ,  (9) 

where  Pa  is  the  orthogonal  projection  onto  the  subspace  corre¬ 
sponding  to  the  D  +  1  largest  eigenvalues  of  R,  were  D  is  the 
known  rank  of  the  interference  subspace. 

The  Capon,  loaded  Capon  and  eigenspace  beamformers,  can 
all  be  viewed  as  MVDR  beamformers  with  a  particular  estimate  of 
Ri+e.  In  the  sequel,  we  use  R  to  denote  the  interference+noise 
covariance  matrix,  where  R  is  equal  to  R;+e  when  R,+e  is  avail¬ 
able,  and  is  otherwise  chosen  as  any  of  the  estimates  above. 

The  class  of  MVDR  beamformers  assumes  explicitly  that  the 
steering  vector  a  is  known  exactly.  Recently,  several  robust  beam- 
formers  have  been  proposed  for  the  case  in  which  the  steering  vec¬ 
tor  is  not  known  precisely,  but  rather  lies  in  some  uncertainty  set 
[9,  10,  11],  Although  originally  developed  to  deal  with  steering 
vector  mismatch,  the  authors  of  the  referenced  papers  suggest  us¬ 
ing  these  robust  methods  even  in  the  case  in  which  a  is  known,  in 
order  to  deal  with  the  mismatch  in  the  interference+noise  covari¬ 
ance.  Each  of  the  above  robust  methods  is  designed  to  maximize 
a  measure  of  SINR  on  the  uncertainty  set.  Specifically,  in  [9],  the 
authors  suggest  minimizing  w*Rw  subject  to  the  constraint  that 
!w*c|  >  1  for  all  possible  values  of  the  steering  vector  c,  where 
|| c  —  a||  <  t.  The  resulting  beamformer  is  given  by 


w  = 


a  R,+ea 


(5) 


The  solution  (5)  is  also  referred  to  as  the  minimum  variance  distor¬ 
tionless  response  (MVDR)  beamformer,  since  it  can  be  obtained  as 
the  solution  to 


min  w  ‘Ri+  ew  subject  to  w*a  =  1.  (6) 

W 

In  practice,  the  interference+noise  covariance  matrix  R,+e  is 
often  not  available.  In  such  cases,  the  exact  covariance  R,+e  in 
(5)  is  replaced  by  an  estimated  covariance.  Various  methods  exist 
for  estimating  the  covariance  R,+e.  The  simplest  approach  is  to 
choose  the  estimate  as  the  sample  covariance 

1  N 

R=^^y^)yW*'  (7) 

v  t= i 

The  resulting  beamformer  is  commonly  referred  to  as  the  sample 
matrix  inversion  (SMI)  beamformer  or  the  Capon  beamformer  [13, 
14],  If  the  signal  is  present  in  the  training  data,  then  it  is  well 
known  that  the  performance  of  the  MVDR  beamformer  with  R ,-+„ 
replaced  by  R  of  (7)  degrades  considerably  [6]. 

An  alternative  approach  for  estimating  R ;+„  is  the  diagonal 
loading  approach,  in  which  the  estimate  is  chosen  as 

^  i  N 

Rd!=R  +  CI=-^y(i)y(t)*+5I,  (8) 

v  t= 1 

where  £  is  the  diagonal  loading  factor.  The  resulting  beamformer 
is  referred  to  as  the  loaded  SMI  (LSMI)  beamformer  [4,  5],  or  the 


A 


Aa*  (  R  +  Ae2I )  a-1 


R  +  A<VI 


GO) 


where  A  is  chosen  such  that  |w*a  —  1|2  =  e2w*w.  In  practice, 
the  solution  can  be  found  by  using  a  second  order  cone  program. 
In  [10]  the  authors  consider  a  similar  approach  in  which  they  seek 
to  minimize  w*Rw  subject  to  ||w  —  a||  <  e,  which  results  in  the 
beamformer 

(R+  yl)_1a 

w  =  - y - ,  (IT) 

a*(R+yl)  R.(R+yl)a 


where  A  is  chosen  such  that 


(i  +  AR.) 


e.  Finally,  in 


[11]  the  authors  consider  a  general-rank  signal  model.  Adapting 
their  results  to  the  rank-one  steering  vector  case,  their  beamformer 
is  the  solution  to  minimizing  w*Rw  subject  to  |w*a|2  >  1  — 
w*  Aw  for  all  ||  A||  <  e,  and  is  given  by 


w  =  P\  R  +  AI 


(aa* 


(12) 


where  P(A)  is  the  eigenvector  associated  with  the  largest  eigen¬ 
value  of  A,  and  A  is  a  diagonal  loading  factor. 

The  motivation  behind  the  class  of  MVDR  beamformers  and 
the  robust  beamformers  is  to  maximize  the  SINR.  However,  choos¬ 
ing  w  to  maximize  the  SINR  does  not  necessarily  result  in  an  esti¬ 
mated  signal  amplitude  s(t)  that  is  close  to  s(t).  In  an  estimation 
context,  where  our  goal  is  to  deign  a  beamformer  in  order  to  obtain 


an  estimate  s(t)  that  is  close  to  s(t),  it  would  make  more  sense  to 
choose  the  weights  w  to  minimize  the  MSE  rather  than  to  maxi¬ 
mize  the  SINR,  which  is  not  directly  related  to  the  estimation  error 

s(t)  -  s(t). 

If  s  =  w*y,  where  for  brevity  we  omitted  the  index  f,  then 
the  MSE  between  s  and  s  is  given  by 

E(\s~s\2)  =  F(«)  +  |B(s)|2 

=  w’Rw  +  |  s|  “  1 1  —  w*aj2,  (13) 

where  V(s)  =  _E(|s  —  _E(s)|2)  is  the  variance  of  the  estimate  s 
and  B(s)  =  E(s)  —  s  is  the  bias.  Since  s  is  not  known,  we  cannot 
choose  a  beamformer  to  minimize  the  MSE  of  (13).  One  approach 
is  to  force  the  term  depending  on  |s|,  namely  the  bias,  to  0,  and 
then  minimize  the  MSE,  i.e., 

min  w‘Rw  subject  to  w*a  =  1,  (14) 

W 

which  leads  to  the  class  of  MVDR  beamformers.  Thus,  in  addition 
to  maximizing  the  SINR,  the  MVDR  beamformer  minimizes  the 
MSE  subject  to  the  constraint  that  the  bias  in  the  estimator  s  is 
equal  to  0.  However,  this  does  not  guarantee  a  small  MSE,  so  that 
on  average,  the  resulting  estimate  of  s(t)  may  be  far  from  s(t). 
Indeed,  it  is  well  known  that  unbiased  estimators  may  often  lead 
to  large  MSE  values. 

Instead  of  forcing  the  term  depending  on  s  to  zero,  it  would 
be  desirable  to  design  a  robust  beamformer  whose  performance 
is  reasonably  good  across  all  possible  values  of  s.  Based  on  the 
ideas  of  [12],  we  propose  an  MMR  beamformer  whose  MSE  is 
uniformly  as  close  as  possible  to  that  of  the  optimal  beamformer 
that  knows  s,  for  all  possible  values  of  s  in  a  prespecified  region  of 
uncertainty.  Thus,  we  ensure  that  over  a  wide  range  of  values  of  s, 
our  beamformer  will  result  in  a  relatively  low  MSE.  Specifically, 
we  seek  a  beamformer  that  minimizes  the  worst-case  difference 
regret,  namely  the  worst-case  difference  between  its  MSE  and  the 
best  possible  MSE  attainable  using  a  linear  beamformer  when  s 
is  known,  over  a  bounded  set  of  values  |s|.  When  s  is  known, 
the  beamformer  output  has  the  form  s  =  w*(s)y,  where  w  can 
depend  on  s.  As  we  show  below,  even  in  the  case  in  which  s  is 
known,  we  cannot  achieve  a  zero  MSE,  when  restricting  ourselves 
to  linear  beamformers. 

In  [12],  a  minimax  difference  regret  estimator  was  derived  for 
the  problem  of  estimating  an  unknown  vector  x  in  a  linear  model 
y  =  Hx  +  n,  where  H  is  a  known  linear  transformation,  and  n  is 
a  noise  vector  with  known  covariance  matrix.  The  estimator  was 
designed  to  minimize  the  worst-case  regret  over  all  bounded  vec¬ 
tors  x,  namely  vectors  satisfying  x*Tx  <  U2  for  some  U  >  0 
and  some  positive  definite  matrix  T.  It  was  shown  that  the  linear 
MMR  estimator  can  be  found  as  a  solution  to  a  convex  optimiza¬ 
tion  problem  that  can  be  solved  very  efficiently. 

In  our  problem,  the  unknown  parameter  x  =  s  is  a  scalar,  so 
that  an  explicit  solution  can  be  derived,  as  we  show  in  Section  3. 
Furthermore,  in  our  development  we  consider  both  lower  and  up¬ 
per  bounds  on  |s|,  so  that  we  seek  the  beamformer  that  minimizes 
the  worst-case  regret  over  the  uncertainty  region  L  <  \s\  <  U. 
The  bounds  L  and  U  can  either  be  determined  based  on  prior  in¬ 
formation  on  the  signal  amplitude,  or,  in  cases  in  which  no  such 
information  is  available,  these  bounds  can  be  estimated  from  the 
data,  as  we  discuss  in  Section  4.  Thus,  in  practice,  the  only  prior 
information  needed  in  order  to  implement  the  MMR  beamformer 
is  knowledge  of  the  steering  vector. 


3.  THE  MINIMAX  REGRET  BEAMFORMER 


The  MMR  beamformer  is  designed  to  minimize  the  worst-case  re¬ 
gret  7 Z(s,  w),  which  is  defined  as  the  difference  between  the  MSE 
using  an  estimator  s  =  w*y  and  the  smallest  possible  MSE  attain¬ 
able  with  an  estimator  of  the  form  s  =  w*(s)y  when  s  is  known, 
which  we  denote  by  MSE°. 

To  develop  an  explicit  expression  for  MSE°  we  first  determine 
the  estimator  s  =  w*(s)y  that  minimizes  the  MSE  when  s  is 
known.  To  this  end  we  differentiate  MSE  of  (13)  with  respect  to 
w  and  equate  to  0,  which  results  in 

Rw(s)  +  |s|2(a*w(s)  —  l)a  =  0,  (15) 


so  that 

w(s)  =  |s|2(R  +  |s|2aa*)_1a.  (16) 

Using  the  Matrix  Inversion  Lemma  we  can  express  w(s)  as 


w(s)  = 


-R  a. 


1  +  |s|2a*Ra 
Substituting  w(s)  back  into  (13),  MSE0  is  given  by 


(17) 


MSE°  = 


1  +  |s|2a*R_1a  l  +  |s|2a’ 


(18) 


where  for  brevity  we  denote  a  =  a*R_1a. 

Since  s  is  unknown,  we  cannot  implement  the  optimal  beam- 
former  (17).  Instead  we  seek  the  beamformer  s  =  w*y  that  mini¬ 
mizes  the  worst-case  regret  7 Z(s,  w)  =  E(\w*y  —  s|2)  —  MSE° 
subject  to  the  constraint  L  <  \s\  <  U.  Thus  we  seek  the  beam- 
former  w  that  is  the  solution  to  the  problem 


min  max  lZ(s,  w)  =  min<  w*Rw+ 

W  L<\s\<U  -- -  ' 


+  max 

L<\s\<U 


l 


s|2|l  —  w*a|2  — 


Is! 

1  +  IsPa 


•  (19) 


To  develop  a  solution  to  (19),  we  first  consider  the  inner  max¬ 
imization  problem 


/(w)  =  max  j  |s|2|l  -  w*a|2  - 

L<\s\<U 


=  max 
L2<x<U2 


x\l  —  w*a|2  — 


1  +  |s|2a 
x 


1  +  xa 


(20) 


where  x  =  |s|2.  Noting  that  the  function  h(x)  =  ax  —  bx/(c+dx) 
with  b,c,d  >  0  is  convex  in  x  >  0,  we  have  that  for  fixed  w. 


g(x)  =  x\l  - 


w  a  — 


1  +  xa 


(21) 


is  convex  in  x  >  0,  and  consequently  the  maximum  of  g(x)  over 
a  closed  interval  is  obtained  at  one  of  the  boundaries.  Thus, 

/( w)  =  max  g(x)  =  max  (g(L2),  g{U2))  ,  (22) 

Lz<x<Uz 

and  the  problem  (19)  reduces  to 


min  {  w’Rw  4-  max  I  L2jl  —  w*a|2  — 


1  +  L2a’ 


U2  |l-w*a|2- 


U2 


1  +  U2a 


(23) 


We  now  show  that  the  optimal  value  of  w  has  the  form 


w  =  d(a*R-1a)_1R_1a  =  -R-1a,  (24) 

a 

for  some  d.  To  this  end,  we  first  note  that  the  objective  in  (23) 
depends  on  w  only  through  w*a  and  w*Rw.  Now,  suppose  that 
we  are  given  a  beamformer  w,  and  let 

w  =  — R_1a.  (25) 

a 


Then 


and 


»  w  a  *  j 

w  a  =  - a  R  a  =  w  a, 


w*Rw  = 


a*R  xa  = 


|a  w|' 
a 


oFrom  the  Cauchy-Schwarz  inequality,  for  any  vector  x, 
la*x]2  <  a*R  2ax*Rx  =  ax’Rx. 


(26) 

(27) 

(28) 


To  develop  a  solution  to  (32)  subject  to  (34),  we  note  that  both 
/i(d)  and  fu(d)  are  quadratic  functions  in  d,  that  obtain  a  mini¬ 
mum  at  dL  and  du  respectively,  where 


dz, 


du 


aL2 

1  +  aL2’ 

aU 2 

1  +  aU2  ' 


(35) 


Therefore,  the  optimal  value  of  d,  denoted  do,  satisfies 


dL  <  do  <  du- 


(36) 


Indeed,  let  t(d)  =  ma -x(/i(d),  fu(d)),  and  let  to  =  t(do)  be  the 
optimal  value  of  (32)  subject  to  (34).  Since  both  fu{d)  and  fu(d) 
are  monotonically  decreasing  for  d  <  di,  f(d)  >  t(du)  >  to  for 
d  <  dL  so  that  do  >  dL-  Similarly,  since  both  /i(d)  and  fu(d) 
are  monotonically  increasing  for  d  >  du,  t(d)  >  t(du)  >  to  for 
d  >  du  so  that  d  <  du- 

Since  /i,(d)  and  fu(d)  are  both  quadratic,  they  intersect  at 
most  at  two  points.  If  /i(d)  =  fu(d),  then 


Substituting  (28)  with  x  =  w  into  (27),  we  have  that 


w*Rw  < 


<  w*Rw. 


(29) 


(1  (1  +  qL2)(1  +  aU2)  ’ 

so  that  /i(d)  =  fu(d)  for  d  =  d+  and  d  =  d_,  where 


(37) 


It  follows  from  (26)  and  (29)  that  w  is  at  least  as  good  as  w  for 
minimizing  (23).  Therefore,  the  optimal  value  of  w  satisfies 


d±  =  1  i 


1 

7(1  +  aL2)(l  +  aU2) ' 


(38) 


w  = 


a^R  1 

a 


a, 


Denoting  by  X  the  interval  X  =  [dL,  du],  since  d+  >  1,  clearly 
d+  (f:  X.  Using  the  fact  that 


which  implies  that  w  has  the  form  (24)  for  some  d. 
Combining  (24)  and  (23),  our  problem  reduces  to 


•  /  Ml2^  ( t2\i  n2  L" 
mm  < - h  max  \  L  1  -  d  -  — - - , 

d  y  a  \  1  +  aLz 

<31> 

Since  d  is  in  general  complex,  we  can  write  d  =  |  d|  ^  for  some 
0  <  (j>  <  27t.  Using  the  fact  that  |1  —  d|2  =  1  +  \d\2  —  2  cos 
it  is  clear  that  at  the  optimal  solution,  </>  =  0.  Therefore,  without 
loss  of  generality,  we  assume  in  the  sequel  that  d  >  0.  We  can 
then  express  the  problem  of  (31)  as 

min  t  (32) 

t,d 


we  have  that  d_  £  X.  We  now  show  that  the  optimal  value  of  d  is 
do  =  d_ .  If  L  =  U,  then  d_  =  di  =  du  so  that  from  (36),  do  = 
d_.  Next,  assume  that  L  <  U.  In  this  case,  for  d  £  X,  fL(d)  is 
monotonically  increasing  and  fu(d)  is  monotonically  decreasing. 
Denoting  t-  =  f(d_)  and  noting  that  =  /_L(d_)  =  fu(d-), 
we  conclude  that  for  d_  <  d  <  d/,,  fu(d)  >  t-,  and  for  du  < 
d  <  d_,  /L(d)  >  t-  so  that  t(d)  >  t _  for  any  d  £  X  such  that 
d  ^  d_ ,  and  therefore  do  =  d_ . 

We  summarize  our  results  in  the  following  theorem. 

Theorem  1.  Let  s  denote  an  unknown  parameter  in  the  model 
y  =  sa  +  n,  where  a  is  a  known  length-M  vector,  and  n  is  a 
zero-mean  random  vector  with  covariance  R.  Then  the  solution  to 


subject  to 


—  +L2(l-d)2 
a 

-+U2{l-d)2 

a 


L 2 

1  +  aL2 

U2 

1  +  aU2 


<  t; 

t. 


min  max  <  i?(|s  —  s|2)  —  min  77(|s  —  s|2) 

s=w*y  L<\s\<U  I  s=w*(s)y 


(33) 


s  =  1  - 


7(1  +  L2a*R-1a)(l  +  U2a*R-1a) J  a’R-1 


a*R_1y 


The  constraints  (33)  can  be  equivalently  written  as 


fL(d)  = 
fu(d)  = 


aL2 
1  +  aL2 


2 

<f; 


aU2 
1  +  aU2 


2 

<  t. 


(34) 


4.  PRACTICAL  CONSIDERATIONS 

In  our  development  of  the  MMR  beamformer,  we  assumed  that 
there  exists  bounds  L  and  U  on  the  magnitude  of  the  signal  to  be 
estimated.  In  some  applications,  such  bounds  may  exist,  for  exam¬ 
ple  when  the  type  of  the  source  and  the  possible  distances  from  the 


array  are  known.  If  no  such  bounds  are  available,  then  we  may  esti¬ 
mate  them  from  the  data  using  one  of  the  conventional  beamform- 
ers.  Specifically,  let  wc  denote  one  of  the  conventional  beamform- 
ers.  Then,  using  this  beamformer  we  can  estimate  s  as  s  =  w*y. 
We  may  then  use  this  estimate  to  obtain  approximate  values  for  L 
and  U.  In  the  examples  below,  we  choose  U  =  /3|w*y|  for  some 
/3  >  0,  and  L  =  0.  Assuming  that  a  is  known,  with  this  choice  of 
bounds  the  MMR  beamformer  becomes 


£  =  10;  MMR2  was  applied  by  using  (9)  with  D  =  1,  /?  =  8  and 
wc  given  by  the  EIG  beamformer.  It  can  be  seen  in  Figure  1  that 
MMR1  has  the  best  performance  for  SNR  values  between  -6  to 
-4  dB,  whereas  MMR2  has  the  best  performance  between  -3  and 
4  dB.  Figure  2  shows  the  performance  as  a  function  of  the  num¬ 
ber  of  training  data  for  a  fixed  SNR  =  -5  dB.  It  can  be  seen  that 
MMR1  and  MMR2  have  improved  performance  with  larger  num¬ 
ber  of  training  snapshots. 


w  =  ( i  _  1  ^  R  Xa 

\  v/(l  +  /32|wSy|2a*R-1a)y  a*R-Ja 


(40) 


Since  in  most  applications  the  true  covaraince  is  not  available  we 
have  to  estimate  it,  e.g.  using  (7).  However,  as  we  discussed  in 
Section  2,  if  s(t)  is  present  in  the  training  data,  then  a  diagonal 
loading  (8)  or  a  projection  approach  (9)  may  perform  better  than 
(7).  Thus  in  the  examples  below,  the  true  covariance  is  replaced 
by  (8)  or  (9). 


5.  NUMERICAL  EXAMPLES 

To  evaluate  and  compare  the  performance  of  the  proposed  MMR 
method  with  other  techniques,  we  conducted  numerical  examples 
using  the  same  scenarios  as  in  [1 1],  These  consist  of  a  uniform  lin¬ 
ear  array  of  20  omnidirectional  sensors  spaced  half  a  wavelength 
apart.  In  all  the  examples  below  the  interference  and  noise  are 
zero-mean  complex  white  Gaussian  processes.  The  signal  s(t)  is 
continuously  present  throughout  the  training  data  and  the  steer¬ 
ing  vector  a  is  known.  The  plane-waves  of  s(t)  and  interference 
i(t)  have  directions  of  arrival  (DOAs)  of  30°  and  —30°,  respec¬ 
tively,  relative  to  the  array  normal.  The  power  of  the  noise  e(t) 
is  one  and  the  interference-to-noise  ratio  (INR)  in  a  single  sensor 
is  20  dB.  The  merit  function  we  use  to  evaluate  the  performance 
is  the  square  root  of  the  normalized  mean-square  error  NMSE  = 
-E(|s(f)  —  s(f))|2)/i?(|s(f)|2).  Each  result  presented  below  was 
obtained  as  a  sample  mean  from  100  Monte  Carlo  experiments. 

The  performance  of  the  proposed  method  was  compared 
against  six  methods:  the  Capon  beamformer  (CAPON)  [13,  14], 
loading  Capon  beamformer  (L-CAPON)  [4,  5],  eigenspace-based 
beamformer  (EIG)  [6,  7,  8]  and  robust  beamformers  (ROB1, 
ROB2  and  ROB3)  [9,  10,  11],  The  parameters  of  each  of  the  com¬ 
pared  methods  were  chosen  as  suggested  in  the  literature.  For  the 
L-CAPON  (8)  the  diagonal  loading  was  set  as  £  =  10  cr^,  [9,  10] 
with  a2,  being  the  variance  of  the  noise  in  each  sensor,  assumed  to 
be  known  (a%,  =  1  in  this  example);  for  the  EIG  beamformer  (9)  it 
was  assumed  that  the  low  rank  condition  and  number  of  interfer¬ 
es  is  known.  For  the  alternative  robust  methods  we  have  that,  for 
ROB  1(10)  the  upper  bound  on  the  steering  vector  uncertainty  was 
set  as  t  =  3  [9],  for  ROB2  (11),  the  upper  bound  on  the  steering 
vector  uncertainty  was  set  as  e  =  3.5  [10]  and  the  diagonal  loads 
for  ROB3  (12)  [1 1]  were  chosen  as  A  =  30  and  e  =  9.  In  order 
to  show  the  best  possible  performance  by  each  approach,  the  op¬ 
timal  CAPON  and  optimal  MMR  beamformer  are  also  included. 
By  optimal  we  refer  to  the  case  when  the  covariance  matrix  R, 
and  |s(t)|2  for  t  =  1, . . . ,  N  are  known,  in  addition  to  the  steering 
vector  a. 

Example  1  -  Deterministic  signal.  We  chose  s(t)  to  be  a  com¬ 
plex  sine  wave  with  varying  amplitude  to  obtain  the  desired  SNR, 
and  used  30  training  snapshots.  We  implemented  MMR1  with  a 
sample  covariance  matrix  estimated  with  a  loading  factor,  £  =  10 
[9,  10],  /3  =  8  and  wc  given  by  the  L-CAPON  beamformer  with 
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Figure  1:  Performance  comparison  of  the  different  methods  in 
terms  of  the  square  root  of  the  normalized  mean-squared  error  for 
estimating  a  complex  sinewave,  as  a  function  of  signal-to-noise 
ratio  for  a  training  data  of  30  snapshots. 
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Figure  2:  Performance  comparison  of  the  different  methods  in 
terms  of  the  square  root  of  the  normalized  mean-squared  error  for 
estimating  a  complex  sinewave,  as  a  function  of  number  of  training 
snapshots  for  SNR  =  -5  dB. 

Example  2  -  Stochastic  signal.  In  this  example  we  chose  s(t) 
to  be  a  zero-mean  complex  Gaussian  signal  with  varying  variance 
to  obtain  the  desired  SNR,  and  used  30  training  snapshots.  We 
implemented  MMR1  and  MMR2  as  described  in  the  last  example, 


Abstract 


Presentation 


Back  to  TOC 
Next  Abstract 


but  with  p  =  12.  From  Figure  3,  we  can  draw  similar  conclusions 
as  in  the  last  example  about  the  performance  of  optimal  and  practi¬ 
cal  beamformers  presented.  It  can  be  seen  that  MMR1  with  £  =  10 
and  p  =  12,  has  the  best  performance  for  SNR  values  between  -8 
to  -5  dB,  whereas  MMR2  with  p  =  12  has  the  best  performance 
between  -4  and  2  dB.  Also,  it  can  be  seen  in  Figure  4  that  MMR1 
and  MMR2  improve  their  performances  with  a  larger  number  of 
training  snapshots  for  SNR  of  -5  dB. 
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Figure  3:  Performance  comparison  of  the  different  methods  in 
terms  of  the  square  root  of  the  normalized  mean-squared  error  for 
estimating  a  zero  mean  complex  Gaussian  signal,  as  a  function  of 
signal-to-noise  ratio  for  a  training  data  of  30  snapshots. 
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Figure  4:  Performance  comparison  of  the  different  methods  in 
terms  of  the  square  root  of  the  normalized  mean-squared  error  for 
estimating  a  zero  mean  complex  Gaussian  signal,  as  a  function  of 
number  of  training  snapshots  for  SNR  =  -5  dB. 
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•  Conventional  beamformers  typically  maximize  the 
signal-to-interference-plus-noise  ratio  (SINR).  However,  this  may 
not  guarantee  a  good  estimate  of  the  signal. 

•  We  derive  beamformers  for  estimating  a  signal  in  the  presence  of 
interference  and  noise  using  the  mean-squared  error  (MSE)  as  the 
performance  criterion. 

•  Challenge:  the  MSE  depends  on  the  signal  in  the  deterministic 
case,  or  its  power  in  the  stochastic  case,  both  are  unknown. 


To  solve  this  problem,  we  minimize  the  worst-case  regret,  i.e.  the 
difference  between  the  true  MSE  and  smallest  attainable  MSE 
with  a  linear  estimator  that  knows  the  exact  model.  This  results  in 
a  low  MSE  over  a  wide  range  of  signal  values. 
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